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ABSTRACT 

Epidemic diffusion on a graph is a dynamic process that 
transitions simultaneously to all of a node's neighbors, in 
contrast to a random walk, which selects only a single neigh- 
bor. Epidemic diffusion is described by the replicator oper- 
ator, an analog of the graph Laplacian that describes the 
behavior of random walks. We study the properties of the 
replicator operator. We show that the replicator is equiva- 
lent to the symmetric normalized Laplacian on a graph with 
edges reweighted by the eigenvector centralities of their in- 
cident nodes. Thus, more weight is given to edges connect- 
ing more central nodes. We propose a spectral clustering 
method, partitioning the nodes based on the component- 
wise ratio of the replicator's second eigenvector to the first. 
We compare the performance of our clustering technique to 
traditional spectral clustering methods on a variety of real 
world and synthetic graphs. We demonstrate how the repli- 
cator gives preference to cliques and clique-like structures, 
enabling it to more effectively discover communities that 
may be obscured by dense intercommunity linking. 

1. INTRODUCTION 

Clustering is one of the most widely used tools in data anal- 
ysis. It is used to partition a set of items into groups of simi- 
lar, or similarly behaving, items. When items are nodes on a 
graph, with edges linking similar or related items, clustering 
can be framed as a graph partitioning problem: namely, find 
groups of nodes with few edges between groups and many 
edges within groups. Graph partitioning has been used in 
a wide array of distinct applications, including image seg- 
mentation [27], data mining [2], and community detection 
in social networks |17| . 

Spectral clustering is one of the most intensely studied meth- 
ods for graph partitioning [6 22 28 



30 . Spectral cluster- 



ing relies on eigenvectors of the graph Laplacian matrix or 
its normalized versions. The eigenvectors associated with 



the k smallest eigenvalues of the Laplacian can be used to 
partition the graph into k components [28] [30]. Spectral 
clustering performs well in many settings by solving a linear 
problem that is easy to implement, making it an attractive 
option for clustering data. 

Spectral clustering is closely associated with random walks 
on graphs, a dynamic process that is the basis for diffusion. 
A random walk is a stochastic process that transitions from 
a node to a random neighbor of that node, and its dynamics 
are described by the (normalized) graph Laplacian. Spectral 
clustering partitions the graph in such a way that a random 
walk spends a long time within one cluster and seldom jumps 
to a another cluster [27] [25] . Conversely, when a good graph 
partition exists, it will take a long time for a random walk 
to reach its equilibrium distribution [13] . 

Epidemic diffusion represents another type of a dynamic pro- 
cess that can take place on a graph. An epidemic is a pro- 
cess that transitions simultaneously to all the neighbors of a 
given node, rather than a single neighbor. It is often used to 
model the spread of a virus, or innovation, through a social 
network [l][24]. Rece ntly, Lerman and Ghosh introduced the 
replicator matrix [16], an analog of the graph Laplacian, that 
describes epidemic diffusion on graphs. They used the repli- 
cator to simulate dynamics of synchronization in a network 
of oscillators and showed that oscillators coupled via epi- 
demic diffusion synchronize into different communities than 
diffusively coupled oscillators, whose dynamics are described 
by the graph Laplacian. 

In this paper we analyze the properties of the replicator and 
use it for spectral clustering. Specifically, we show that the 
replicator is equivalent to the normalized symmetric Lapla- 
cian of a reweighted graph, where new edge weights are the 
product of old edge weights and the eigenvector centrali- 
ties of the two end points. The eigenvector centrality [5] 
of a graph is given by the eigenvector corresponding to the 
largest eigenvalue of the adjacency matrix, or equivalently 
(by construction), the steady state of the replicator. This 
equivalence allows us to exploit some of the well-known re- 
lationships between spectral clustering and graph partition- 
ing. To use the replicator for spectral clustering, we present 
and motivate a new approach that assigns nodes to clus- 
ters based on the componentwise ratio of the second to first 
eigenvectors. Given N nodes, this method leads to a compu- 
tationally efficient procedure based on evaluating a quality 



measure at N — 1 possible partitions of a vector. 

We apply replicator-based spectral clustering to partition 
synthetic and real- world graphs with known community struc- 
ture and compare the results to traditional spectral cluster- 
ing that uses graph Laplacian matrices. We demonstrate 
that replicator-based clustering leads to a better recovery 
of ground truth on benchmark graphs, especially those that 
are more challenging for the Laplacian. 

We make the following contributions in this paper: we 

• analyze spectral properties of epidemic diffusion on 
graphs, 

• demonstrate equivalence of the replicator and the sym- 
metric normalized Laplacian of the reweighted graph, 

• introduce a procedure for spectral clustering using the 
replicator matrix, and 

• compare performance of spectral clustering using the 
replicator and the Laplacian on a variety of graphs. 

Our work suggests that epidemic diffusion can be a useful 
probe of graph structure as it can illuminate properties of 
graphs that are distinct from those found by methods based 
on the random walk. 

2. BACKGROUND AND RELATED WORK 

An unweighted graph G = (V,E), with vertices (or nodes) 
V and edges E, can be represented by a |V| x |V| matrix A, 
called the adjacency matrix. Here, Aij = 1 if G E, and 
Aij = otherwise. Also, we use the convention An = 0. We 
consider undirected graphs, where Aij = Aji. The degree 
of node i is defined as the number of edges incident on it, 
di = ^2jAij. Other useful constructs are D, a diagonal 



degree matrix where Di 



and the identity matrix I. 



2.1 Graph Laplacian and Spectral Clustering 

The graph Laplacian matrix is defined as L = D — A. The 
eigenvalues and eigenvectors of L capture many properties 
of the graph. In the simplest case, if the graph has k dis- 
joint components, the first k smallest eigenvalues of L are 
zero, and the corresponding leading eigenvectors are indi- 
cator functions assigning nodes to their respective cluster 
or community 30 . Even if the k smallest eigenvalues are 
not all zero, their corresponding eigenvectors can be used 
to partition nodes into k clusters by projecting these nodes 
onto a subspace of the first k eigenvectors and using stan- 
dard clustering techniques such as /c-means [22| |27| . The 
simplest spectral clustering method, spectral bisection, par- 
titions nodes based on the values of the second eigenvector 
v of the adjacency matrix or the graph Laplacian. A split- 
ting value c is used to divide the nodes into different clusters 
based on whether v t < c or v t > c 28 . A range of split- 
ting values have been used, including zero, the median value 
within the vector, the largest gap, and the value producing 
the best ratio cut, best conductance 14 , or other measure. 

In practice, normalized versions of the graph Laplacian pro- 
duce better results in spectral clustering applications [22] 
[5]. Two examples are the symmetric normalized Laplacian 
L s = I — D -1 / 2 AD -1 / 2 and the random walk Laplacian 



L rw — I — D 1 A, so named because the transition proba- 
bility of a random walk on a graph is given by D~ x A. 

2.2 Graph Cuts and Their Quality Measures 

Intuitively, a cluster is a set of nodes S C V that are more 
tightly connected to other nodes within the cluster than to 
nodes outside of the cluster. We use S — V \ S to denote 
the complement of S, which consists of nodes that are not 
in S. In order to partition the graph into disjoint clusters, 
one typically wants to minimize the number of cut edges 
between partitions, 



cutiS, S) = Ai - 



iesjes 

while maximizing cluster size, which may be measured by 
the number of nodes it contains, 15*1, or the sum of the de- 
grees of the nodes in the set, vol(S) = J2i^s 

Several functions have been proposed for measuring the qual- 
ity of a graph cut. The best known of these are conductance 
<t>(S), ratio cut RCut(S), and normalized cut NCut(S): 
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There is a relationship between graph cuts and spectral clus- 
tering. Deciding which edges to cut to optimize any of these 
quality functions is an NP-complete problem. Spectral clus- 
tering solves a relaxation of the problem, where the discrete 
indicator variables that assign nodes to clusters become con- 
tinuous. Although in general there are no useful bounds 
for the approximation produced by this relaxation [30], in 
practice it often provides a simple and effective clustering 
method. Solutions to the relaxed optimization problem are 
given by the second eigenvector of the graph Laplacian L 
or the normalized graph Laplacian L s [28]. Relaxing RCut 
leads to spectral clustering using L, while relaxing NCut 
leads to spectral clustering using L s [27] |30]. 



Conductance is a popular choice for evaluating the quality 
of a partition and has been used to identify communities in 
social and information networks 6 . Although conductance 
fails to identify communities in certain real- world networks, 
where they blend in by linking heavily to the rest of the net- 
work [17 , it is nevertheless a valuable basis for comparison. 

2.3 Spectral Clustering and Random Walks 

There exists a further relationship between spectral cluster- 
ing, the partition quality function, and properties of random 
walks. A random walk on a graph is a stochastic process that 
transitions to a randomly chosen neighbor of a given node. 
Cluster properties of the graph can be expressed in terms of 
the transition matrix of a random walk Z) -1 A 18 . Spectral 
clustering finds a partition such that a random walk stays 
within the same cluster for a long time and seldom transi- 
tions between clusters [27] [25]. Therefore, the presence of 
a good partition (e.g., low conductance cut) implies that it 



will take a random walk a long time to reach its equilibrium 
distribution. 

3. EPIDEMIC DIFFUSION ON GRAPHS 

An epidemic is a dynamic process with some probability of 
transitioning simultaneously to every neighbor of the cur- 
rent node. Such processes are used to model the spread 
of disease [l2] and innovation [24] in social networks. Epi- 
demics differ from random walks in important ways. First, 
rather than choosing a single neighbor to transition to or 
"infect" as the random walk does, an epidemic will attempt 
to "infect" every neighbor of a node. During a random walk, 
the probability to find the walker anywhere on the graph re- 
mains constant, and the random walk transition matrix is a 
stochastic matrix. Epidemics, alternatively, are locally non- 
conservative processes 16 . One can think of an epidemic 
as replicating itself with each successful transmission. 

Lerman and Ghosh [16] introduced the replicator operator 
R = XmaxI — A to describe dynamics of nodes coupled via 
epidemic diffusion. Xmax is the largest eigenvalue of A, also 
known as the epidemic threshold [3TL In this system, a 
dynamic variable u% associated with node i can change its 
value based on the values of its neighbors according to: 



du 

~dt 



-Ru, 



(4) 



where R replaces the Laplacian used in the analogous heat 
equation that gives the (diffusive) evolution of a random 
walk on a graph 5 . By construction, the replicator has 
a steady state given by 0, the eigenvector of A associated 
with Xmax- AO — XmaxO. is also known as the eigenvector 
centrality 13], and it was introduced by Bonacich to explain 
the importance of actors in a social network based on the 
importance of the actors to which they were connected. 

Clusters of nodes with similar values of the dynamic variable 
u emerge as the system of coupled nodes evolves towards 
the steady state [16]. This motivates a community detec- 
tion method with nodes classified according to the rate of 
convergence to their steady- state values. For large time t, 
we approximate the solution to Eq. [4] using the two leading 
eigenvectors and ip of R, 



Ui(t) 



ciOi + c 2 e X2t i/Ji 



at 



Cl Vi 



where c\ and C2 are constants, and A2 is the second smallest 
eigenvalue of R associated with eigenvector if>. Therefore, 
convergence depends on ipi/9i, the componentwise ratio of 
the second to first eigenvectors. Note that eigenvectors of R 
corresponding to i£'s two smallest eigenvalues are the same 
as the eigenvectors of A corresponding to A's two largest 
eigenvalues. 

3.1 Replicator as the Laplacian of a 
Reweighted Graph 

In a social network, one might expect nodes of high "im- 
portance" to serve as attractors of other nodes, resulting 
in communities forming around nodes with large eigenvec- 
tor centrality values Si. In this section we propose a mod- 
ification of our graph, converting the unweighted network 



into a weighted one where weights are given by the prod- 
uct of the eigenvector centralities of an edge's end points: 
Aij = AijOiOj. Moreover, we show that the replicator on the 
unweighted graph given by A is in fact exactly equivalent 
to the symmetric normalized Laplacian of the reweighted 
graph given by A. 

In the reweighted graph, the degree of node i is given by 



AijOiOj — Oi ^ AijOj — X 
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maxVi • 



For convenience, define as the diagonal matrix whose ele- 
ments are the components of eigenvector 0, i.e. ®u. Then, 



from and di above, 



A 0A0 and D X max 



(5) 



We can now write the symmetric normalized Laplacian of 
the reweighted graph: 

~ ~ -1/2 ~ ~ -1/2 

L s = I-D AD 

1 ^ 0A0 ( — L= 1 



Vx, 



Xmax 

- R. 



Xn 

Hence, R = Xma X L s . 

The equivalence between random walks and epidemics at 
first appears surprising, because these processes are funda- 
mentally so different. In random walks, the probability to 
find the walker on any node of the graph is conserved, while 
epidemics are non-conservative 16 . The intuition for this 
equivalence is the following. A node's eigenvector centrality 
gives the number of paths connecting it to other nodes in 
the graph 10 . Since the epidemic replicates with each tran- 
sition, the product of eigenvector centralities of two nodes 
captures how much new spreading "quantity" is produced 
when the epidemic transitions along the edge linking these 
nodes. By encoding the amount of non-conservation in edge 
reweighting, this scheme allows the epidemic to be reduced 
to a simple random walk on the graph. 

3.2 Quality Measure for the Replicator 

The equivalence proved above allows us to leverage the prop- 
erties of the symmetric normalized Laplacian, along with 
its relationship to graph partitioning, for epidemic diffu- 
sion. Since the replicator is simply L s on a graph that is 
reweighted according to the scheme in Eq. [5] spectral clus- 
tering using the replicator corresponds to a relaxation of 
NCut on this reweighted graph. The appropriate measure 
for assessing graph cut quality with the replicator is there- 
fore NCut on the reweighted graph. 

4. SPECTRAL CLUSTERING VIA EPIDE- 
MIC DIFFUSION 

We propose a clustering method based on epidemic diffu- 
sion. Our clustering method seeks to minimizes NCut on 
the reweighted graph. This often results in a partition differ- 
ent from that found by traditional spectral clustering meth- 



ods that attempt to minimize conductance, RCut, or NCut 
on the original graph. 

4.1 Motivating Example 

We use a simple example to highlight the differences between 
traditional graph partitioning and those based on epidemic 
diffusion. Consider the toy graph in Figure [I] We expect 
a good partition to group node 6 with other nodes in its 
clique, rather than separate it from its clique. However, the 
cut (B) that minimizes conductance and NCut groups node 
6 with nodes 1-5 and assigns nodes 7-11 to the other cluster. 
There are multiple cuts that minimize RCut, including one 
that forms a community consisting of nodes 3-5. 

Now we reweight the edges of the graph according to eigen- 
vector centrality, using the prescription A = 0A0. Node 
6 has the highest centrality. Furthermore, nodes that be- 
long to the clique have higher eigenvector centrality values 
than other nodes, making the edges linking node 6 to the 
rest of the clique more "expensive" to cut. Consequently, 
nodes 6-11 are grouped together by the preferred cut (A) for 
minimizing both RCut and NCut on the reweighted graph. 
(Minimizing the conductance on the reweighted graph gives 
preference to cut (B), placing node 6 with nodes 1-5 and 
not with the clique.) The quality measure values are given 
in Table [I] Epidemic diffusion thus tends to preserve cliques 
and clique-like structures. 




Figure 1: (Left) Toy graph. (Right) Reweighted 
toy graph with edge weights given by the product 
of eigenvector centralities of the edges's two end- 
points. The red edges have weight 13.8, and the 
blue edges have weight 17.6. (Both) The possible 
optimal cuts are shown by the dotted curves A and 
B. (Best viewed in color) 



Measure 


Graph 


Cut A 


Cut B 


Conductance <j) 
RCut 
NCut 


Original 
Original 
Original 


0.385 
1.83 

0.528 


0.217 
1.83 
0.417 


Conductance cj) 
RCut 
NCut 


Reweighted 
Reweighted 
Reweighted 


0.683 
11.4 
0.747 


0.536 

32.3 
0.778 



Table 1: Quality measures of cuts A and B for the 
graph and reweighted graph of Figure [TJ 

Tong et al. [29] propose a method for selecting which edges 
to delete to minimize the spread of an epidemic on a graph. 
Their method selects edges between nodes with highest eigen- 
vector centralities. Our work provides an insight into the 
method. In the toy example, edges connecting node 6 to its 



clique along cut (B) will be deleted by their method, thus 
preventing the epidemic from spreading to the clique. The 
larger the clique, the higher the eigenvector centrality score 
of its nodes; therefore, edges connecting the clique to the 
rest of the graph are more likely to be chosen for deletion. 

4.2 Our Clustering Method 

We propose a clustering method based on spectral bisec- 
tion. First, we create a vector v that is the componentwise 
ratio of the second eigenvector i/> to the first eigenvector 
of the operator R and sort its values. Next, we examine all 
partitions given by the N — 1 possible cuts in this ordering 
and pick the partition that minimizes a quality measure [28] . 
The quality measures that we use with R are conductance 
on the original graph and NCut on the reweighted graph, 
which we denote u NCut (reweighted)" in the tables summa- 
rizing our results. We compare the resulting partitions with 
those produced by applying an analogous procedure to L, 
with quality measures conductance and RCut, and L s , with 
quality measures conductance and NCut (on the original 
graph). Additionally, for all three operators, we compare 
with the standard spectral clustering technique of /c-means 
clustering on the first two eigenvectors corresponding to the 
smallest two eigenvalues of the operators [30] , and the results 
are denoted in our tables as "/c-Means." 

Since our optimization procedure tests all N — 1 possible 
cuts within v, it is far more exhaustive than /c-means. It 
may seem that there would be some loss in accuracy from 
restricting our search to cuts in a one-dimensional projec- 
tion, rather than searching over the entire subspace spanned 
by the first two eigenvectors and However, it has been 
observed [33j V27\ that the componentwise ratio of the sec- 
ond to first eigenvector of L s is precisely equal to the second 
eigenvector of the random walk Laplacian L rw , whose first 
eigenvector is a constant vector. Thus, our algorithm is ef- 
fective because it is a computationally efficient procedure for 
finding the best NCut in the two-dimensional eigenspace of 
L rw , i-e., L rw on the reweighted graph. The advantages of 
using L rw in spectral clustering are discussed in [30] . 

5. EXPERIMENTAL RESULTS 

In order to examine the differences in clustering using the 
operators L, L s , and R, we first return to the motivating 
example of Section [4. 1| We then turn to communities where 
the ground truth is known. The real world examples that we 
will see are given in Section [5.2| To better understand the 
clustering mechanisms and the types of graphs each opera- 
tor will perform the best, we construct random graphs with 
ground-truth communities. The description of these graphs 
and their results are provided in Section [53] 

5.1 Motivating Example 

Figure [I] displays the toy graph and the same network with 
reweighted edges. We apply our clustering methods using 
the operators L, L s , and R, splitting according to the op- 
erator's corresponding quality measure, RCut, NCut, and 
NCut on the reweighted graph. Also, we apply the clus- 
tering techniques to these same operators using the conduc- 
tance quality measure on the original graph. All the result- 
ing partitions are located in Table [2] The majority of the 
methods prefer cut (£?), which splits the nodes 1-6 and 7-11. 



Operator 


Method 


Class 1 


Class 2 


L 


Conductance 


1-6 


7-11 


L s 


Conductance <j) 


1-6 


7-11 


R 


Conductance <j> 


1-6 


7-11 


L 


RCut 


Multiple 


Ties 


L s 


NCut 


1-6 


7-11 


R 


NCut (reweighted) 


1-5 


6-11 



Table 2: Partitions of graph in Figure [T] using our 
clustering methods. Note that only the bottom row 
uses a measure on the reweighted graph. 



However, the replicator is the only one that places node 6 in 
the other community when minimizing with respect to the 
NCut on the reweighted graph. This reflects the influence 
of reweighting the graph edges. 

5.2 Real World Networks 

A first test for using our clustering algorithm is to examine 
real world networks with identified communities. By apply- 
ing our method to social networks, we are able to investigate 
the role of epidemic diffusion and the different operators in 
clustering. The data sets we present come from a network 
of monks in a monastery, a network of dolphins from New 
Zealand, and the U.S. House of Representatives. 

To evaluate the resulting clustered communities, we use the 
Normalized Mutual Information (NMI) measure [7] and the 
Purity measure [20] , both of which examine how similar the 
resulting partition is when compared to the ground truth 
communities. For both measures, a value of 1.0 is optimal. 

5.2. 1 Sampson 's Monastery 

In 1969, Sampson observed a community of 18 monks at a 
monastery for one year [26]. During this time, a breakup of 
the monastery occurred when monks 2, 3, 17, and 18 were 
expelled from the monastery and monks 1, 7, 14, 15, and 16 
voluntarily left immediately. Eventually, the only remain- 
ing monks were 5, 6, 9, and 11. At three times prior to this 
event, Sampson had the monks rank the top three individ- 
uals they liked. After the breakup, he recorded additional 
rankings to include dislike, esteem and disesteem, positive 
and negative influence, and praise and blame. 

Using the ranking data, we create a social network of the 
monks and attempt to find the partition between those that 
left immediately, either voluntarily or by expulsion, and 
those that initially stayed. To do this, we first consider all 
edges that connect monks that mutually listed each other 
as one of their top 3 individuals during any of the liking 
rankings prior to the splitting. We then remove edges where 
either monk ranked its neighbor in the top 3 of the dislike, 
disesteem, negative influence, or blame categories. This will 
account for changes in attitude over the year. The resulting 
network is shown in Figure [2] For alternative methods of 
network construction, see e.g. [4]. 

From this network, we use our clustering methods with the 
goal of recreating the partition of individuals that stayed 
and those that left immediately. These results are provided 
in Table [3] Note that R has substantially higher metric 
values for this network, mislabeling only monks 12 and 13, 




Figure 2: Sampson's Monastery Network. The 
two groups are separated by colors and the dotted 
curve. The upper group gives the individuals that 
left immediately. (Best viewed in color.) 

two monks that eventually left the monastery after some 
time had passed. The other operators perform poorly. 





Method 


NMI 


Purity 


L 


Conductance <j) 


0.0606 


0.6111 


L s 


Conductance 


0.0606 


0.6111 


R 


Conductance 


0.0606 


0.6111 


L 


RCut 


0.0606 


0.6111 


L s 


NCut 


0.0606 


0.6111 


R 


NCut (reweighted) 


0.5926 


0.8889 


L 


/c-Means 


0.0606 


0.6111 


L s 


/c-Means 


0.0606 


0.6111 


R 


/c-Means 


0.5926 


0.8889 



Table 3: Results for partitioning the group of monks 
in a monastery using our clustering methods and k- 
means clustering on the first two eigenvectors. 



5.2.2 Dolphin Network 

A study by Lusseau et al. [l9] examined the social behav- 
iors of 62 dolphins in New Zealand. A network was created 
by linking two dolphins that were observed together and is 
shown in Figure [3] At some point during the study, the dol- 
phins split into two groups when the individual, represented 
by the node with a white interior, departed. 

While our method is not as successful in recovering the two 
communities, this graph is instructive for another reason. 
The node with the black interior is in the red community 
but is not connected to any red node other than the one that 
departed. This suggests that the network may be formed 
from incomplete observations, and indeed most partitioning 
methods misclassify this node. For example, the cuts for 
L and L s , as well as R with conductance, have better per- 
formance (Table [4]), but they all misclassify this node, as 
does the modularity method of 21 . When optimizing the 
reweighted NCut with R, however, the reweighting forces it 
to remain in the proper group in spite of the possible sam- 
pling bias that may account for the replicator's lower NMI 
and purity scores. 

5.2.3 House of Representatives 

The 98th United States House of Representatives voting 
data set from 1983-1985 provides information on how con- 
gressmen voted on 908 different issues [23] . This congress 
was comprised of 272 Democrats and 163 Republicans. We 




Figure 3: Dolphin Network with two groups indi- 
cated by color. The cuts represent the partitions se- 
lected by (A) the modularity method of |21|, (B) the 
cuts for L and L s , as well as R with the conductance 
quality measure, and (C) R with the reweighted 
NCut quality measure. (Best viewed in color.) 





Method 


NMI 


Purity 


L 


Conductance 4> 


0.8888 


0.9839 


L s 


Conductance <j) 


0.8888 


0.9839 


R 


Conductance 4> 


0.8888 


0.9839 


L 


RCut 


0.8888 


0.9839 


L s 


NCut 


0.8888 


0.9839 


R 


NCut (reweighted) 


0.6292 


0.9194 


L 


/c-Means 


0.8888 


0.9839 


L s 


/c-Means 


0.8888 


0.9839 


R 


/c-Means 


0.7769 


0.9677 



Table 4: Results for partitioning the dolphins using 
our clustering methods and /c-means clustering on 
the first two eigenvectors. 



construct a network for the 435 individuals by considering 
co- votes. If two individuals both vote the same on a mea- 
sure, then we add 1 to the edge weight between the nodes. 
If they vote opposite of one another, then we add —1 to the 
edge weight. The final network is taken by thresholding the 
final edge weight between nodes, considering edges to exist 
only if the weight is greater than T. Politicians of separate 
parties may agree on some issues. Therefore, setting T = 
would create a nearly complete graph. Instead, we set T 
equal to the average value of the final edge weights. 

A subset of this dataset consisting of 16 votes has been used 
for clustering congressmen [5J [II] . The votes were chosen by 
the Congressional Quarterly Almanac as the key votes for 
this congress 9 . We create a network from these 16 votes 
with 47,772 edges. When applying our clustering methods to 
this network, we obtain the best results with L s and R, min- 
imizing with respect to the corresponding quality measures 
of NCut on the original and reweighted graph, respectively. 
The purity scores are 0.8782 for L s and 0.8759 for R. 

However, selecting the key votes to use is a subjective pro- 
cess that eliminates much of the data. Additionally, an im- 
portant subset of votes is generally not available. If instead 



we use all 908 votes, we obtain the network shown in Fig- 
ure [4] This network has a density of 0.5260 and average 
clustering coefficient of 0.8682. There are 51,033 edges in 
this network with 8,111 between the two parties. 




Figure 4: 98th Congress Network with 908 votes. 
Nodes on the left indicate democrats and nodes on 
the right indicate republicans. An edge is present 
if two individuals have an edge weight greater than 
the average weight of T — 252.4. (Best viewed in 
color.) 



We use both the conductance metric and the respective qual- 
ity measures for clustering this network with the different 
operators, attempting to divide the nodes into the two polit- 
ical parties. Table [5] shows the performance of the methods, 
indicating that the L operator works best with conductance, 
whereas the other two prefer their respective quality mea- 
sures. Additionally L s and R give the same splitting when 
using the conductance quality measure. However, R per- 
forms the best overall with the reweighted NCut. Further- 
more, the purity scores for L s and R are significantly higher 
for the graph that used all 908 votes than the 16 votes. 





Method 


NMI 


Purity 


L 


Conductance <j> 


0.5346 


0.8934 


L s 


Conductance 


0.5794 


0.9184 


R 


Conductance <j> 


0.5794 


0.9184 


L 


RCut 


0.0032 


0.6168 


L s 


NCut 


0.5988 


0.9229 


R 


NCut (reweighted) 


0.6318 


0.9297 


L 


/c-Means 


0.0002 


0.6168 


L s 


/c-Means 


0.5874 


0.9206 


R 


/c-Means 


0.5327 


0.9048 



Table 5: Results for partitioning the 98th U.S. 
House of Representatives (from 908 votes) using our 
clustering methods and /c-means clustering on the 
first two eigenvectors. 



5.3 Synthetic Benchmarks 

We use synthetic graphs to gain better insight into the char- 
acteristics of graphs for which different operators find better 
solutions. Lancichinetti and Fortunato proposed an algo- 
rithm to generate random graphs with known hierarchical 
structure [15] . The N nodes are divided into macro com- 
munities, which are themselves composed of micro commu- 
nities, and then edges between nodes are created using mix- 
ing parameters fi\ and ji2- The parameter \i\ designates 



the fraction of a node's edges that will connect to nodes in 
a different macro community, and 112 gives the fraction of 
edges that will connect to nodes in a different micro com- 
munity within the same macro community. The remaining 
(1 — jii — 112) fraction of edges link to other nodes within 
the same micro and macro communities. These benchmark 
networks allow us to systematically explore the performance 
of different spectral clustering approaches. 

Using software available on [8], we generated 100 networks 
for each set of parameter values. We took N — 100 with two 
macro communities. We varied /n and \±<2 between and 0.5. 
Our goal is to correctly identify the macro communities. 

To better understand the properties of the generated ran- 
dom graphs, we look at the average clustering coefficient. 
The clustering coefficient for a node is given by taking the 
number of its neighbors that are connected by an edge di- 
vided by the total number of possible triangles. The average 
clustering coefficient takes the mean value for all nodes. A 
complete graph has an average clustering coefficient of 1, 
and a graph with no edges between nodes has a value 0. 
The heatmap in Figure [5] shows the mean average cluster- 
ing coefficient over the 100 runs for fixed parameters, with 
/ii and /12 ranging between and 0.5. The mean clustering 
coefficient ranges between 0.23 and 0.6421. This indicates 
the synthetic graphs have graph properties similar to those 
often found in real world social networks [32]. 
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Figure 5: Each pixel represents the mean average 
clustering coefficient (left) and the standard devia- 
tion (right) across 100 runs for fixed (/ii,/i2). (Best 
viewed in color.) 

5.3. 1 Results with the Conductance Quality Measure 
Figure [6] shows the results for minimizing the conductance 
quality measure in splitting. Each pixel in the left column of 
images represents the average NMI value across 100 runs for 
fixed parameter values (fii,/i2). Note that as \i\ increases, 
the number of edges between the two communities increases, 
making it more difficult to determine the partitioning. The 
right column provides the standard deviation of NMI across 
the runs. 

The main difference between the plots is that L s produces 
a higher average NMI score than L as \i\ increases. Addi- 
tionally, R produces a higher average NMI score than L s as 
/ii increases. Therefore, R provides the best results of the 
three operators for a wider range of fi±. We also see that 
R has substantially lower standard deviation than the other 
two operators, suggesting that the NMI scores are consis- 
tently higher. To highlight the regions where each operator 
performs the best, we take the operator (s) with the highest 
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Figure 6: NMI scores for minimizing the conduc- 
tance quality measure. Each pixel represents the av- 
erage (left) or standard deviation (right) NMI score 
across 100 runs for fixed (/ii,/i2). (Best viewed in 
color.) 



average score at each point and give it a designated color. 
The color scale and best average value images are shown in 
Figure [7| and multiple listed operators indicate a tie. We 
observe that R has the highest average NMI score for larger 
in values, and multiple operators tie for smaller in values. 
Since parameter /ii controls the fraction of edges connect- 
ing different communities, the replicator is better able to 
reconstruct the original communities in graphs where the 
community structure is obscured by intercommunity links. 

5.3.2 Results with the Related Quality Measure 
As seen in Section [4] the operators L, L s , and R are related 
to the minimization problems of RCut, NCut, and NCut on 
a reweighted graph, respectively. In this section, we com- 
pare the results for each operator when minimizing their 
respective quality measures. We then calculate the average 
and standard deviation of the NMI scores for a fixed set of 
parameters and display the results in Figure [8] Included in 
Figure [7] is the image which identifies the operator(s) with 
the best average NMI score. For a tie, multiple operators 
are listed. We see similar results as when the partitioning 
was done with respect to the conductance quality measure. 
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Figure 7: Best NMI with the conductance quality 
measure (Top Left) and the operators' respective 
quality measures (Top Right). (Top) Each pixel rep- 
resents the operator(s) with the best average NMI 
value across 100 runs for fixed parameter values 
(/ii,/i2). (Bottom) Color scale for operators. Mul- 
tiple operators indicate a tie in the average NMI 
value. (Best viewed in color.) 



5.4 Analysis 

The clustering methods using the replicator proposed in this 
paper perform well and often do better than traditional spec- 
tral clustering methods. The first example of Section |5.1| 
demonstrates how the replicator operator tends to favor 
cliques when clustering. For Sampson's monastery graph, 
the replicator operator performed exceptionally well com- 
pared to the rest, only mislabeling two of the monks that 
most algorithms would have as well. The dolphin network 
results demonstrate the differences when minimizing with re- 
spect to the weighted NCut and conductance, and all three 
operators give the same results with cut (B) when using the 
conductance quality measure, outperforming the modularity 
method. With a larger network, the U.S. House of Repre- 
sentatives' voting data shows R has slightly better perfor- 
mance than L s . Thus, when compared to known ground 
truth communities from the real world, our proposed clus- 
tering techniques are able to identify groups of individuals 
with like characteristics. 

The synthetic benchmarks provide us with a general idea of 
the parameter regimes where each operator has its strengths. 
As the proportion of a node's edges that connect to individ- 
uals in the opposite community, /xi, increases, it becomes 
more difficult to divide the network into the correct commu- 
nities. Through the examples of Section [573] we find that L 
and L s give better results when \i\ is small (very few links 
between the two communities). As \i\ increases, R dom- 
inates with a higher NMI score. Additionally, R has the 
lowest standard deviation of the three operators, indicating 
a consistent performance in identifying clusters. 

6. CONCLUSION 

Spectral clustering is traditionally done with the Laplacian, 
but this is one of many operators used. In this paper, we in- 
troduced a method for spectral clustering using the replica- 
tor, an operator describing epidemic diffusion on graphs. We 
have shown that this operator is equivalent to the normalized 
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Figure 8: NMI scores for minimizing the respective 
operators' quality measure. Each pixel represents 
the average (left) or standard deviation (right) NMI 
score across 100 runs for fixed (/ii,/i2). (Best viewed 
in color.) 



symmetric Laplacian on a graph with edges reweighted ac- 
cording to the eigenvector centrality measure. By reweight- 
ing the edges, a higher weight is placed on globally important 
nodes. Thus, this method tends to preserve cliques. 

We introduced a spectral bisection approach based on the 
componentwise ratio of the second eigenvector to the first 
of R and chose the partition by splitting the sorted vec- 
tor where a quality measure is minimized. We compared 
our method to spectral clustering based on L and L s and 
showed that in many real-world and synthetic graphs with 
known community structure, the replicator was better able 
to recover the underlying community structure. In synthetic 
graphs, when more edges connect the two macro commu- 
nities, the Laplacian and symmetric normalized Laplacian 
have a more difficult time identifiying the communities. In 
these cases, the replicator gives the best performance. By 
reweighting the edges using eigenvector centrality, more im- 
portance is given to more central nodes. Thus, the edges 
that pass between regions are given less influence if they 
are not linking nodes of high centrality. This gives a better 
partition by limiting the cuts to influential edges. 
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